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(54) Edge-enhancement processing apparatus and method 



(57) An edge-enhancement processing apparatus 
which removes problems of the conventional edge en- 
hancement processing, which requires checking by an 
operator's visual observation or a high-frequency band 
filter, thus complicating the construction. A computer 
main body 21 , as the nucleus of edge enhancement 
processing, calculates an edge amount as vector 
change level while generating a vector based on the dif- 
ference values of data between adjacent pixels, at step 
S1 10, then selects and integrates edge amounts of only 
pixels having large edge amounts at steps S120 and 
S130, and obtains the mean value at step S230, to ob- 
tain the sharpness level of the image while adding at- 
tention to the pixels having large image change levels. 
The computer main body 21 determines an edge en- 
hancement level Eenhance based on the image sharp- 
ness level. Thus, the computer main body 21 automat- 
ically performs edge enhancement processing at an op- 
timum enhancement level. 
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Description 

Technical Field to which the Invention Belongs 

5 [0001] The present invention relates to an edge-enhancement processing apparatus and method for performing 
edge enhancement processing based on multi-level image data representing an image with pixels in dot matrix, and 
a medium containing an edge-enhancement processing program. 

Related Background Art 

10 

[0002] Conventionally, image-processing software programs for performing edge enhancement processing to en- 
hance edge portions on image data representing a photograph orthe like are known. These programs read image data 
into a computer, convert the image data at different edge enhancement levels by trial and error. An operator checks 
the converted result on a display screen by visual observation, thus adjusting it to have appropriately enhanced edge 
15 portions. 

[0003] Japanese Patent Application Laid-Open No. 6-68252 discloses obtaining high frequency components in edge 
areas of an image by using a high-frequency band filter, judging the sharpness of the image based on the mean value 
of the high frequency components and controlling an edge enhancement parameter. 

[0004] In the former case, since the converted result must be checked by the operator's visual observation, an ap- 
20 propriate enhancing level cannot be automatically set. 

[0005] In the latter case, since the high frequency components are obtained by using the high-frequency band filter, 
the processing is complicated. 

Disclosure of the Invention 

25 

[0006] Accordingly, an object of the present invention is to provide an edge-enhancement processing apparatus and 
method capable of judging the sharpness of an image with simpler method and automatically performing optimum 
edge enhancement processing. 

[0007] The edge-enhancement processing apparatus provided by the present invention is an edge-enhancement 
30 processing apparatus comprising: image-data obtaining unit which obtains multi-level image data representing an im- 
age with pixels in dot matrix; summation processing unit which calculates a change level of each pixel based on dif- 
ferences of luminance or substitute values for luminance between the pixel and peripheral pixels, as a vector value, 
and sums up vector values of pixels having large vector values; edge-enhancement element determination unit which 
determines an edge enhancement element while judging a sharpness level of the image based on the result of sum- 
35 mation; and edge-enhancement unit which performs edge enhancement processing on respective edge pixels based 
on the determined edge enhancement element. 

[0008] In the present invention having the above construction, when the image-data obtaining unit obtains multi-level 
image data representing an image with pixels in dot matrix, the summation processing unit calculates a change level 
of each pixel based on differences of luminance or substitute values for luminance between the pixel and peripheral 
40 pixels, as a vector value, and sums up vector values of pixels having large vector values. On the other hand, the edge- 
enhancement element determination unit determines an edge enhancement element while judging the sharpness level 
of the image based on the result of summation. The edge enhancement unit performs edge enhancement processing 
on respective edge pixels based on the determined edge enhancement element. 

[0009] That is, upon calculating the sharpness level of the image from change levels of respective pixels on the 
45 premise that the enhancement level is not necessarily greatly raised if the image is sharp, the change level of each 
pixel is calculated based on the differences of luminance or substitute values for luminance between the pixel and 
peripheral pixels, as a vector value. The image change levels are obtained in pixel units on the premise that the image 
data is composed of pixels in dot matrix. 

[0010] On the other hand, assuming that an object to be image-sensed is called a subject and the area other than 
50 the subject is called a background, the operator considers edge enhancement processing only based on the sharpness 
level of the subject and takes little account of the background. In this case, the subject is usually sharper than the 
background. Accordingly, when the sharpness level of the image is judged based on the result of summation with 
respect to pixels having large change level, the judgment is made on the same condition as that for judgment with 
respect to the subject. 

55 [0011] According to the present invention, as a vector value is calculated based on the differences of luminance or 
substitue values for luminance between each pixel and peripheral pixels, to determine the edge enhancement element, 
an edge-enhancement processing apparatus which automatically performs edge enhancement processing can be 
provided with a simple construction. 
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[0012] As described above, when calculating the sharpness level of the image from change levels of respective 
pixels, the calculation of a vector value based on the differences of luminance or substitute values for luminance be- 
tween each pixel and peripheral pixels are not necessarily realized by a hardware apparatus, but may be realized as 
a method for the apparatus. Accordingly, the present invention provides an edge-enhancement processing method for 

5 performing edge enhancement processing on multi-level image data representing an image with pixels in dot matrix, 
comprising: a step of calculating a change level of each pixel based on differences of luminance or substitute values 
for luminance between the pixel and peripheral pixels, as a vector value, and summing up vector values of pixels having 
large vector values; a step of determining an edge enhancement element while a judging sharpness level of the image 
based on the result of summation, while; and a step of performing edge enhancement processing on respective edge 

10 pixels based on the determined edge enhancement element. 

[0013] That is, the edge enhancement processing is effective not only when embodied with a hardware apparatus 
but when embodied as a method for the apparatus. 

[0014] The summation processing unit calculates a change level of each pixel based on differences of luminance or 
substitute values for luminance between the pixel and peripheral pixels, as a vector value. If the image data has pixel 

15 data in dot matrix arranged in vertical and lateral directions, there are eight adjacent pixels around a pixel of interest. 
However, in evaluation, comparison may not be necessarily made with all these adjacent pixels. 
[0015] Accordingly, another object of the present invention is to provide an example of the summation processing 
unit. To attain the object, in the edge-enhancement processing apparatus provided by the present invention, when the 
summation processing unit calculates a change level of each pixel based on differences of luminance or substitute 

20 values for luminance between the pixel and peripheral pixels, as a vector value, employs the differences of luminance 
or substitute values for luminance among a plurality of pixels which are not arrayed in a linear direction. 
[0016] According to the present invention having the above construction, as the vector is generated based on the 
differences of luminance or substitute values for luminance among a plurality of pixels which are not arrayed in a linear 
direction, the number of pixels taken into consideration upon vector generation is the half of that in the previous con- 

25 struction. That is, in case of pixels adjacent to each other, the vector elements arrayed in a linear direction interact with 
each other, therefore, evaluation on these pixels may be omitted without significant influence. 
[0017] In this manner, according to the present invention, the vectors can be obtained in pixel units with small amount 
of calculation processing. 

[0018] Further, as the summation processing unit to sum up the change levels of the pixels to judge the sharpness 

30 level of the image, various types of processing units may be employed. 

[0019] Further, another object of the present invention is to provide an example of the summation processing unit. 
[0020] In the edge-enhancement processing apparatus provided by the present invention, said summation process- 
ing unit performs the summation such that as the vector value increases, a weight increases. 
[0021] In the present invention having the above construction, when the summation processing unit sums up the 

35 change level, the weight is increased as the change level increases. The summation includes reducing the weight as 
the change level decreases. In any case, the sharpness level of the image is judged while making much account on 
a sharp portion such as a subject. 

[0022] Further, the result of summation is not limited to a specific value, but may be a mean value or a median as 
long as it is a central value in statistical meaning. 
40 [0023] In this manner, according to the present invention, the influence levels of pixels are controlled by changing 
the weight, and an optimum edge enhancement element can be determined. 

[0024] Further, in this example, the summation is performed on pixels having substantially large change levels by 
changing the weight, however, it is not limited to this arrangement. 

[0025] Further, another object of the present invention is to provide an example of summation on pixels having sub- 
45 stantially large change levels. 

[0026] In the edge-enhancement processing apparatus provided by the present invention, said summation process- 
ing unit performs summation on outline pixels having large change level. 

[0027] In the present invention having the above construction, the summation processing unit sums up the change 
levels of pixels having large vector values. That is, the summation is performed only on outline pixels, making no 
50 account on pixels other than the outline pixels, and the sharpness level of the image is judged based on the result of 
summation. Accordingly, an image portion with low sharpness level such as a background is not taken into consideration 
in image sharpness level judgment unless It is determined as an outline portion. 

[0028] In this manner, according to the present invention, as the sharpness level of the image is judged only at outline 
portions having large image change level, an optimum edge enhancement level can be set without influence by the 
55 size of the background or the like. 

[0029] The edge enhancement element is not limited to the enhancement level, but it includes various control con- 
ditions for enhancement processing. 

[0030] Further, another object of the present invention is to provide an example of control condition for enhancement 
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processing. 

[0031] In the edge-enhancement processing apparatus provided by the present invention, said edge-enhancement 
element determination unit determines an enhanced-pixel selection condition so as to perform edge enhancement 
processing only on pixels having vector values higher than a predetermined threshold value, based on the result of 
5 summation. 

[0032] In the present invention having the above construction, the edge-enhancement element determination unit 
determines the enhanced-pixel selection condition based on the result of summation so as to perform enhancement 
processing only on pixels having vector values higher than the predetermined threshold value. That is, enhancement 
processing is performed only on pixels having change levels higher than the predetermined threshold value, apart from 
10 the enhancement level, which avoids enhancement on a portion which is not an edge portion. 

[0033] In this manner, according to the present invention, image quality can be improved by avoiding enhancement 
processing on non-edge portions. 

[0034] When the threshold value is set based on the result of summation, the threshold value is set so as not to 
perform edge enhancement processing on non-edge pixels. More specifically, various references can be employed in 
15 the threshold setting. 

[0035] Further, another object of the present invention is to provide a specific threshold-value setting method. 
[0036] In the edge-enhancement processing apparatus provided by the present invention, said edge-enhancement 
element determination unit determines the threshold value based on the ratio of the pixels having the large vector 
values. 

20 [0037] In the present invention having the above construction, when setting the enhanced-pixel selection condition, 
the edge-enhancement element determination unit obtains the ratio of pixels having large vector values and determines 
the threshold value based on the ratio. That is, if the number of pixels having large change levels is large in the entire 
image, the threshold value is lowered so as to perform enhancement on many pixels. If the number of pixels having 
large change levels is small in the entire image, the threshold value is raised so as not to easily perform enhancement 

25 on non-edge pixels. 

[0038] In this manner, according to the present invention, as the threshold value is set based on the ratio of pixels 
having large change levels in the entire image, if the entire image is sharp, the threshold value is lowered so as to 
perform edge enhancement processing on more pixels, to improve the image quality, while if the entire image is unsharp, 
the threshold value is raised so as not to easily perform edge enhancement processing, to avoid edge enhancement 
30 processing on non-edge pixels. 

[0039] The enhancement level may be determined not only based on the vector values as described above, but 
based on other factors. 

[0040] Accordingly, another object of the present invention is to provide an edge-enhancement processing apparatus 
in consideration of the other factors. 
35 [0041] In the edge-enhancement processing apparatus provided by the present invention, said edge-enhancement 
element determination unit detects an image size of the image, and determines the edge enhancement element such 
that as the image size increases, the edge enhancement level increases. 

[0042] In the present invention having the above construction, when the edge-enhancement element determination 
unit determines the edge enhancement element, the unit detects the image size of the image data, and sets the edge 
40 enhancement element such that as the image size increases, the enhancement level increases . When an operator 
tries to recognize an image or the like, if the image is large, the operator tends to seethe image from apart Accordingly, 
in such case, the enhancement level must be raised so that the large image has the same visual effect of equal value 
as the small one. 

[0043] In this manner, according to the present invention, a further optimum edge enhancement level can be set by 
45 using thejmage size, corresponding to effect of edge enhancement processing, as a reference for edge-enhancement 
element determination. 

[0044] On the other hand, the edge enhancement processing itself performed by the edge enhancement unit may 
be any processing as long as it is performed based on the determined enhancement element, and its concrete method 
is not limited to a specific method. 
so [0045] Accordingly, another object of the present invention is to provide a more specific example of edge enhance- 
ment processing. 

[0046] In the edge-enhancement processing apparatus provided by the present invention, said edge enhancement 
unit has unsharp masks of different sizes, and selects one of the unsharp masks in correspondence with different edge 
enhancement levels. 

55 [0047] In the present invention having the above construction, as the unsharp masks of different sizes are provided, 
enhancement is performed by selecting one of the unsharp masks, in correspondence with the different edge enhance- 
ment levels. As the unsharp mask is greater, more peripheral pixels are processed, which blurs the image. However, 
in the edge enhancement processing, the unsharp components are subtracted, which reinforces the edge enhancement 
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processing. 

[0048] In this manner, according to the present invention, the edge enhancement level can be controlled compara- 
tively easily by changing the size of the unsharp mask. 

[0049] The edge-enhancement processing apparatus may be a single apparatus or installed into another apparatus. 
5 Thus, the concept of the invention is not limited to the above edge-enhancement processing apparatus but includes 
various aspects. Accordingly, the present invention may be appropriately modified. For example, the present invention 
may be embodied with software or hardware construction. 

[0050] In a case where the concept of the present invention is embodied as a software program for an edge-en- 
hancement processing apparatus, the present invention is utilized as the software program recorded in a recording 
10 medium. 

[0051] Further, another object of the present invention is to provide a recording medium in which the software is 
recorded, 

[0052] The medium containing an edge-enhancement processing program provided by the present invention is a 
medium containing an edge-enhancement processing program for performing edge enhancement processing by a 

15 computer on multi-level image data representing an image with pixels in dot matrix, said program including: a step of 
calculating a change level of each pixel based on differences of luminance or substitute values for luminance between 
the pixel and peripheral pixels, as a vector value, and summing up the vector values ; a step of determining an edge 
enhancement element while judging a sharpness level of the image based on the result of summation; and a step of 
performing edge enhancement processing on respective edge pixels based on the determined edge enhancement 

20 element. 

[0053] The recording medium may be a magnetic recording medium or an magneto-optical recording medium, or 
further, any recording medium to be developed in the future. Furthermore, the recording medium may be a duplicated 
product such as a primary duplicated product or a secondary duplicated product. Further, the present invention can 
be utilized by providing the present invention via a communication line, or using the present invention written in a 

25 semiconductor chip or the like. 

[0054] Further, even if the present invention is embodied partially with a software construction and partially with a 
hardware construction, the concept of the present invention is not different at all, further, it may be arranged such that 
a part of the present invention is stored on a recording medium and appropriately read in accordance with necessity. 
[0055] In this manner, according to the present invention, a medium where the edge-enhancement processing pro- 

30 gram is recorded can be provided. 

[0056] In the point that image quality is improved by increasing the edge enhancement level as the image becomes 
greater, the sharpness level of the image should not be necessarily calculated from change levels of respective pixels. 
[0057] Accordingly, further object of the present invention is to provide an edge-enhancement processing apparatus 
and method capable of performing optimum edge enhancement processing in accordance with the size of an image. 

35 [0058] The edge-enhancement processing apparatus provided by the present invention is an edge-enhancement 
processing apparatus comprising: image-data obtaining unit which obtains multi-level image data representing an im- 
age with pixels in dot matrix; edge-enhancement level obtaining unit which obtains an edge enhancement level; edge- 
enhancement level correction unit which detects an image size of the image data, and corrects the edge enhancement 
level such that as the image size increases, the edge enhancement level increases; and edge enhancement unit for 

40 corrected enhancement level which performs edge enhancement processing on respective edge pixels based on the 
corrected edge enhancement level. 

[0059] In the present invention having the above construction, the edge-enhancement level obtaining unit obtains 
the edge enhancement level, and for edge enhancement on respective edge pixels based on the edge enhancement 
level, the edge-enhancement level correction unit detects the size of the image, and corrects the enhancement level 
45 such that as the image size increases, the edge enhancement level increases, and the edge enhancement unit for 
corrected enhancement level performs edge enhancement on respective edge pixels based on the corrected edge 
enhancement level. 

[0060] According to the present invention, as the size of the image corresponding to the effect of edge enhancement 
processing is also used as a reference for edge-enhancement level setting, a more optimum enhancement level of 

50 edge enhancement processing can be. set. 

[0061] It will be easily understood that the correction on the enhancement level in accordance with the size of the 
image should not be necessarily realized by a hardware apparatus, but it may be realized as a method for the apparatus. 
Accordingly, the edge-enhancement processing method provided by the present invention is an edge-enhancement 
processing method for performing edge enhancement processing on multi-level image data representing an image 

55 with pixels in dot matrix, comprising: a step of obtaining multi-level image data representing an image with pixels in 
dot matrix; a step of obtaining an edge enhancement level; a step of detecting an image size of the image data, and 
correcting the edge enhancement level such that as the image size increases, the edge-enhancement level increases; 
and a step of performing edge enhancement processing on respective edge pixels based on the corrected edge en- 
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hancement level. 

[0062] That is, the preset invention is effective not only when embodied with a hardware apparatus but when em- 
bodied as a method for the apparatus. 

[0063] In this case, the concept of the present invention is not limited to the method, but it includes various aspects. 
5 For example, the present invention is realized in the form of a software program. 

[0064] In a case where the concept of the present invention is embodied as a software program for an edge-en- 
hancement processing apparatus, the present invention is utilized as the software program recorded in a recording 
medium. 

[0065] Further, another object of the present invention is to provide a recording medium in which the software is 
10 recorded. 

[0066] The medium containing an edge-enhancement processing program provided by the present invention is a 
medium containing an edge-enhancement processing program for performing edge enhancement processing by a 
computer on multi-level image data representing an image with pixels in dot matrix, said program including: a step of 
obtaining multi-level image data representing an image with pixels in dot matrix; a step of obtaining an edge enhance- 
rs ment level; a step of detecting an image size of the image data, and correcting the edge enhancement level such that 
as the image size increases, the edge enhancement level increases; and a step of performing edge enhancement 
processing on respective edge pixels based on the corrected edge enhancement level. 

[0067] As described above, according to the present invention, a medium containing a program for performing the 
above edge-enhancement processing can be provided. 

20 

Brief Description of the Drawings 
[0068] 

25 Fig. 1 is a block diagram showing an image processing system to which an edge-enhancement processing appa- 

ratus according to an embodiment of the present invention is applied; 

Fig. 2 is a block diagram showing the hardware construction of the edge-enhancement processing apparatus; 
Fig. 3 is a perspective view showing an another example to which the edge-enhancement processing apparatus 
of the present invention is applied; 
30 Fig. 4 is a perspective view showing an another example to which the edge-enhancement processing apparatus 

of the present invention is applied; 

Fig. 5 is a flowchart showing a main routine in the edge-enhancement processing apparatus of the present inven- 
tion; 

Fig. 6 is a flowchart showing image edge-amount summation processing; 
35 Fig. 7 is an explanatory view showing the size of image data and the position of a pixel of interest moved during 

the processing; 

Fig. 8 is a graph showing an image change level represented by respective component values of rectangular 
coordinates; 

Fig. 9 is an explanatory view showing a case where the image change level is obtained from difference values 
40 between adjacent pixels in a vertical-axial direction and a lateral-axial direction; 

Fig. 10 is an explanatory view showing a case where the image change level is obtained from difference values 

between adjacent pixels in all directions; 

Fig. 11 is an example of image data with a small background; 

Fig. 12 is an example of image data with a large background; 
^5 Fig. 13 is a graph showing pixels to be subjected to summation as outline pixels; 

Fig. 14 is a flowchart showing edge-enhancement element determination processing; 

Figs. 15 (a)-15 (c) are graphs showing the relation between edge amount distribution and a threshold value; 

Fig. 16 is a graph showing the relation between an image size and an applicable level; 

Fig. 17 is a flowchart showing edge enhancement processing; 
so Fig. 18 is a table showing a minimum-sized unsharp mask; 

Fig. 19 is a table showing a middle-sized unsharp mask; 

Fig. 20 is a table showing a maximum-sized unsharp mask; and 

Fig. 21 is a table showing the relation between an edge amount and a weight upon integration with weighting. 

55 Description of Special Embodiment 

[0069] Preferred embodiment of the present invention will now be described in detail in accordance with the accom- 
panying drawings. 
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[0070] Fig. 1 is a block diagram showing an image processing system to which an edge-enhancement processing 
apparatus according to an embodiment of the present invention is applied. Fig. 2 is a block diagram showing the 
hardware construction of the edge-enhancement processing apparatus. 

[0071] In Fig. 1 , an image input device 10 outputs image data, representing a photograph or the like with pixels in 
5 dot matrix, to an image processor 20. The image processor 20 executes image processing to perform edge enhance- 
ment processing at a predetermined enhancement level. The image processor 20 outputs the edge-enhancement 
processed image data to an image output device 30. The image output device 30 outputs an edge-enhancement 
processed image represented with pixels in dot matrix. The image data outputted from the image processor 20 is 
corrected image data having improved sharpness by enhancement on unsharp image edges. The image processor 
10 20 has an image-data obtaining unit which obtains image data from the image input device 1 0, a summation processing 
unit which calculates a change level by each pixel based on a luminance level value and sums up change level, an 
edge-enhancement element determination unit which determines an edge enhancement element based on the result 
of summation, and an edge enhancement unit which performs enhancement on respective edge pixels based on the 
determined edge enhancement element and outputs the edge-enhancement processed image data to the image output 
15 device 30. 

[0072] As shown in Fig. 2, the image input device 10 is realized by a scanner 11 , a digital still camera 12, a video 
camera 14 or the like. The image processor 20 is realized by a computer system comprising a computer 21 , a hard 
disk 22, a keyboard 23, a CD-ROM drive 24, a floppy disk drive 25, a modem 26 and the like. The image output device 
30 is realized by a printer 31, a display 32 or the like. In the present embodiment, edge enhancement processing is 
20 performed as image processing, the image data preferably represents a natural image such as a photograph. Note 
that the modem 26 is connected to a public communication line, and connected to an external network via the public 
communication line for downloading software program and data. 

[0073] In the present embodiment, the scanner 1 1 or the digital still camera 1 2 as the image input device 1 0 outputs 
RGB (red, green and blue) multi-level data as image data. The printer 31 as the image output device 30 inputs CMY 

25 (cyan, magenta and yellow) multi-level data or CMYK (cyan, magenta, yellow and black) binary data. The display 32 
inputs RGB multi-level data. On the other hand, an operating system 21a operates in the computer main body 21 , 
further, a printer driver 21b for the printer 31 and a display driver 21c for the display 32 are installed in the computer 
main body 21 . Further, an image-processing application program 21 d executes a predetermined image processing in 
cooperation with the printer driver 21b and the display driver 21c in accordance with necessity, under the control of 

30 the operating system 21a. Accordingly, the computer main body 21 as the image processor 20 inputs RGB multi-level 
data, performs edge enhancement processing at an optimum enhancement level on the input data, displays the edge- 
enhancement processed RGB multi-level data on the display 32 via the display driver 21c, and at the same time, 
converts the data into CMY binary data and print-outputs the converted data by the printer 31 via the printer driver 21b. 
[0074] In this manner, in the present embodiment, a computer system is provided between image input device and 

35 image output device for edge enhancement processing, however, the computer system is not always necessary, but 
any system which performs edge enhancement processing on image data can be employed. For example, the system 
may be arranged as shown in Fig. 3, where an image processing device for edge enhancement processing is incor- 
porated in a digital still camera 12a, and converted image data is displayed on a display 32a or print-outputted by a 
printer 31a. Further, as shown in Fig. 4, it may be arranged such that, a printer 31b inputs image data via a scanner 

40 11b, a digital still camera 12b, a modem 26b or the like without a computer system, and prints an image based on the 
input image data. In the printer 31 b, edge enhancement processing is automatically performed on the input image data. 
[0075] The edge enhancement processing is made by the image processing program in the computer main body 21 
corresponding to the flowchart as shown in Fig. 5. In the flowchart, at step S100, edge amounts of respective pixels 
are calculated and summed up forjudging the sharpness level of the image, then at step S200, an edge enhancement 

45 element is determined based on the result of summation, and at step S300, edge enhancement processing is performed 
in accordance with the edge enhancement element. 

[0076] First, at step S1 00, edge amounts are summed up to judge the sharpness level of the image. The summation 
processing is shown in more detail in the flowchart of Fig. 6. 

[0077] Assuming that the image data is composed of pixels in dot matrix, each pixels is represented by multi-level 
50 RGB luminance data. At an edge portion of the image, the difference of the luminance data between adjacent pixels 
is large. The difference, which is a luminance gradient, is called an edge amount. As shown in Fig. 7, edge amounts 
are summed up while scanning the respective pixels constituting the image. 

[0078] At step S110, the edge amount of the each pixel is judged. In case of considering an XY rectangular coordi- 
nates as shown in Fig. 8, the vector of a image change level can be calculated by obtaining an X-axis directional 
55 component and a Y-axis directional component. In a digital image composed of pixels in dot matrix, the pixels are 
adjacent to each other in a vertical axial direction and a lateral axial direction as shown in Fig. 9. The brightness of 
these pixels are represented byf (x,y). In this case, f(x,y) may be R(x,y), G(x,y) and B(x,y) as respective RGB luminances 
or a total luminance Y(x,y). Note that the relation between the RGB luminances R(x,y), G(x,y) and B(x,y) and the total 
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luminance Y(x,y) cannot be converted without referring to a color conversion table or the like, in the strict sense, 
however, for the simplification of the processing, the correspondence as represented by the following equation is uti- 
lized. 

Y-0.30R + 0.59G + 0.11B (1) 
[0079] In Fig. 9, the X-directional difference value fx and the Y-directional difference value fy are represented by: 

fx = f(x+1,y)-f(x,y) (2) 



fy = f(x,y+1)-f(x,y) • (3) 

15 

Accordingly, a size lg(x,y)l of the vector having these components is a vector value represented by: 

|g(x,y)| = (fx**2+fy"2r(1/2) (4) 

20 

The edge amount is represented by this lg(x,y)l. Note that the pixels are arranged into matrix in the vertical and lateral 
directions as shown in Fig. 10, and when the central pixel is regarded as a pixel of interest, there are eight adjacent 
pixels Accordingly, it may be arranged such that the differences between the pixel of interest and the respective adjacent 
pixels are represented by vectors, and the sum of the vectors is judged as the change level of the image. Note that it 

25 can be said that the less the number of pixels to be compared is, the less the amount of calculation is. Further, regarding 
the adjacent pixels arrayed in at least a linear direction, they interact with each other when the position of a pixel of 
interest moves. Accordingly, the calculation on these pixels may be omitted. To further reduce the calculation amount, 
the difference of luminance may be calculated only between adjacent pixels arrayed in the lateral direction. The cal- 
culation is made by utilizing the luminance, however, if substitute values for the luminance are used in the calculation, 

30 including simple calculation, substantially the same results can be obtained. 

[0080] Even though the edge amount of each pixel is obtained as described above, the sharpness level of the image 
cannot be obtained only by obtaining the edge amounts of all the pixels and averaging the obtained edge amounts. 
Figs. 11 and 12 show pictures of airplanes in flight. Apparently, in these figures, the sky portions as the backgrounds 
of the images do not have a great image change level. However, assuming that the airplanes as the subjects have the 

35 same sharpness level, if image sharpness level is respectively obtained by averaging edge amounts of all the pixels, 
the sharpness level of the image in Fig. 12, having the airplane of the same sharpness level as that of the airplane in 
Fig. 11 but including a greater background than that in Fig. 11 , is lower than that of the image in Fig. 11 . Accordingly, 
averaging is not appropriate in obtaining image sharpness level. 

[0081] In consideration of this situation, in the present embodiment, the mean value of the edge amounts of all the 
40 pixels is not obtained, but the mean value of only edge amounts of outline portions is obtained so as to judge how 
sharp the outline portions is in the image. Fig. 13 shows a histogram in a case where edge amounts are summed up 
with respect to all the pixels, indicating that only pixels having edge amounts over a threshold value are subjected to 
the summation. More specifically, at step S120, the edge amount is compared with a predetermined threshold value 
to determine whether or not the pixel belongs to an outline portion. Only if the pixel belongs to an outline portion, the 
45 process proceeds to step S1 30, in which the edge amount is integrated, and the number of pixels in the outline portions 
is integrated. 

[0082] To perform the pixel-based judgment on all the pixels, at step S140, the position of pixel of interest is moved 
as shown in Fig. 7, and the processing is repeated until it is determined at step S1 50 that the judgment on all the pixels 
has been completed. 

so [0083] When the edge amounts have been summed up as above, edge-enhancement element determination is 
performed at step 5200. The edge-enhancement element determination is shown in more detail in the flowchart of Fig. 
14. 

[0084] First, at step S210, the ratio of edge pixels is calculated. As the number of outline pixels (edge_pixel) has 
been integrated at step S130, the ratio of the number of outline pixels (edge_rate) with respect to the number of all the 
55 pixels (totaLpixel) is calculated: 



edge_rate = edge_pixel/total_pixel 
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[0065] As the ratio (edge_rate) is closer to "1", the image has more edge pixels. The sharpness level of the airplane 
in the image in Fig. 11 and that in Fig. 12 are the same, however, the number of background pixels in the image in Fig. 
11 and that in Fig. 12 are different. The background image of the greater number of pixels is rather blurred, but it is 
not necessarily sharp. That is, it is preferable to avoid performing edge enhancement processing on the background 
pixels. Such background includes a gradation portion of blue sky, a skin portion of a portrait and the like. 
[0086] In the present embodiment, a threshold value ST, used for determining pixels to be subjected to edge en- 
hancement processing, is obtained by utilizing the above ratio, as follows: 

ST = K/edge_rate 

[0087] Note that "K" is a constant. Figs. 15(a) to 15(c) show the relation between the edge amount distribution and 
the threshold value ST. In Fig. 15(a), the total edge amount is large. As it is determined that the number of outline 
pixels is large, a threshold value ST0 is low. In Fig. 1 5 (c) , the total edge amount is small, therefore, a threshold value 
ST2 is high. Fig. 15(b) shows an intermediate threshold value ST1 between those in Figs. 15 (a) and 15 (c) . That is, 
when the number of sharp pixels is small, the threshold value ST is set to a high value, so that more pixels are judged 
as non-edge pixels in determination of non-edge pixel. This avoids enhancement on noise in a skin portion or the like. 
[0088] Next, at step S230, the integrated edge amount is divided by the number of pixels in the outline portions, to 
obtain only the mean value of the edge amounts in the outline portions. That is, the sharpness level SL of this image 
is calculated by: 



SL = S lg(*,y) l/E(I)pix ... (5) 

E(l)pix: the number of outline pixels 
In this case, the sharpness level of an image having a low SL value is determined as low (apparently blurred), while 
the sharpness level of an image having a high SL value is determined as high (apparently clear). 
[0089] On the other hand, as image sharpness is sensuous, the sharpness level SL is obtained in a similar manner 
from image data of an experimentally-obtained optimum sharpness level, then the obtained sharpness level SL is set 
as an ideal sharpness ievel SLopt, and an edge enhancement level Eenhance is obtained by: 

Eenhance = KS " (SLopt-SL)**(1/2) (6) 

In equation (6), the coefficient KS changes in accordance with image size. As shown in Fig. 7, if the image data is 
composed of "height" dots in the vertical direction and "width" dots in the lateral direction, the coefficient KS is obtained 
by: 

KS = min (height, width)/A (7) 

In equation (7), "min(height,width)" indicates "height" dots or "width" dots as a smaller number of dots. "A" is a constant 
having a value "768". They have been experimentally obtained and may be appropriately changed. Basically, excellent 
results have been obtained by increasing the enhancement level as the image size becomes greater, 
[0090] When the edge enhancement level Eenhance and the threshold value ST have been obtained as described 
above, edge enhancement processing is performed on all the pixels at step S300. The edge enhancement processing 
is shown in more detail in the flowchart of Fig. 17. In this case, the pixel of interest is determined in advance, and as 
shown in Fig. 7, the position of the pixel of interest is moved to scan all the pixels. Note that at step S31 0, the above- 
described threshold value ST and the edge amount of each pixel are compared to determine whether or not the pixel 
is to be subjected to edge enhancement processing. If the edge amount is greater than the threshold value ST, it is 
determined that the pixel is to be subjected to edge enhancement processing, and at step 5320, edge enhancement 
processing is performed on the pixel. 

[0091] Step S320 is edge enhancement processing calculation. With respect to the luminance Y of each pixel before 
it is edge-enhanced, a luminance Y' of the edge-enhanced pixel is calculated by: 
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Y' = Y + Eenhance ' (Y-Yunsharp) 



(8) 



In equation (8), "Yunsharp" indicates image data of each pixel which has been unsharp-mask processed. Next, the 
unsharp mask processing will be described. Figs. 18 to 20 show unsharp masks 40 (41 to 43) of three different sizes. 
The unsharp mask 40 is utilized for integration on matrix image data, such that the central value "100" is used as a 
weight for the pixel of interest Y(x,y), and values of the unsharp mask corresponding to the peripheral pixels are used 
as weights for the peripheral pixels. If the unsharp mask 42 in Fig. 19 is used, the integration is made in accordance with: 



In equation (9) , the value "632" is a sum of weight coefficients. In the different sized unsharp masks 41 to 43, the sum 
of weight coefficients are respectively "396", "632" and "2516". Further, "Mij" indicates a weight coefficient given in a 
cell of the unsharp mask; and "Y(x,y)", image data of each pixel. Note that "ij" indicates coordinate values in the row 
and column directions in the different sized unsharp masks 41 to 43. 

[0092] In the edge enhancement calculation based on equation (8), "Yunsharp(x } y)" is weighting with lower weight 
values with respect to the peripheral pixels than that with respect to the pixel of interest. As a result, so-called "blurred 
(unsharp)" image data is obtained. The blurred image data is similar to image data passed through a so-called low- 
pass filter. Accordingly, "Yfx.yJ-Yunsharpfx.y)" means subtraction of a low frequency component from the initial entire 
component, i.e., "Y(x p y)-Yunsharp(x,y)" obtains image data similar to high-pass filtered image data. Then, the high- 
pass filtered high frequency component is multiplied by the edge enhancement level Eenhance, and the multiplied 
result is added to "Y(x,y)". This increases the high frequency component in proportion to the edge enhancement level 
Eenhance, as a result, the edge is enhanced. 

[0093] On the other hand, the edge enhancement level also changes dependent on the size of the unsharp mask. 
In the three unsharp masks 41 to 43 having different numbers of rows and columns, as the mask is greater, the weighting 
with respect to the peripheral pixels around a pixel of interest is greater, while the weighting gradually decreases toward 
distant pixels. In other words, as the mask is greater, the weighting characteristic as a low-pass filter increases, and 
the generation of high frequency component can be made more easily in accordance with equation (8). 
[0094] Accordingly, if the edge enhancement level Eenhance is high, the large unsharp mask 43 is used, while if the 
edge enhancement level Eenhance is low, the small unsharp mask 41 is used. In case of an intermediate number of 
pixels, the middle sized unsharp mask 42 is used. 

[0095] As it is apparent from these figures, the unsharp mask 40 has the greatest weight coefficient at its central 
portion, andgradually-decreasing weighting values toward its ends. The variation of the weighting is not necessarily 
fixedly determined but may be appropriately changed. The mask is not necessarily an "unsharp mask", and its size is 
not limited to those shown in the figures. It may be composed of 6 x 6 cells or 8 x 8 cells. 

[0096] Note that in the calculation in equation (9), multiplications and additions are required for the number of cells 
in the unsharp mask 40, with respect to the pixels around the pixel of interest, and the processing amount is large, 
accordingly, the unsharp mask is arranged so as to reduce the processing amount. In a case where the unsharp mask 
40 of an appropriate size is employed, calculation is not necessarily required for all the cells. In the unsharp mask 42 
having 7 x 7 cells in Fig. 19, the weighting with respect to the outmost peripheral cells is "0" or'TV Incase of weighting 
by "0", the multiplication by "0" is meaningless, while in case of weighting by "1", very low weighted results are obtained 
in comparison with the total cell value "632". 

[0097] In view of this situation, in the present embodiment, calculation is not performed with respect to all the cells 
of the 7 x 7-cell unsharp mask 42, but an unsharp mask 44 having 5x5 cells within a double-line block in the unsharp 
mask 42 is used. By using the unsharp mask 44, the outmost peripheral portion of the 7 x 7-celi unsharp mask 42 is 
omitted. Similarly, the outmost peripheral portion of the 13 x 13-cell unsharp mask 43 maybe omitted. The 7 x 7-cell 
unsharp mask 42 has 48 (=7x7-1) pixels around a pixel of interest, and multiplication and addition for these pixels are 
required. However, in use of the 5 x 5-cell unsharp mask 44 which substantially obtains the same calculation result, 
calculation is performed 24 (=5x5-1) times, i.e., the calculation amount is reduced to the half of that in case of the 
unsharp mask 42; in case of the 1 3 x 1 3-cell unsharp mask 43, the calculation amount is reduced from 1 68 (=1 3x 1 3-1 ) 
times to 120 (=11 x 11-1) times. 

[0098] Further, since edge enhancement is required in so-called image edge portions, the processing is limited to 
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portions where image data greatly changes between adjacent pixels. In consideration of this situation, it may be ar- 
ranged such that the calculation is performed when there is a large difference of image data between adjacent pixels. 
This un necessitates the calculation with an unsharp mask at almost all image data portions which are not image edges, 
thus greatly reduces processing. 

[0099] Note that the luminance Y has been described as the luminance of each pixel, for the sake of assistance of 
understanding, however, each pixel actually has RGB multi-level data, and the luminance Y is converted by simple 
weighting on the RGB multi-level data as shown in equation (1). 

[0100] From the edge-enhanced luminance Y' and the unenhanced luminance Y, substitution is made as: 

delta = Y-Y' (10) 



Then it is possible to calculate converted R'G'B' from equation (10) : 

15 

R' = R + delta 



20 



G' = G + delta 



B' = B + delta 



(11) 



In this calculation, the multiplication and addition become 1/3 , thus the entire processing time can be reduced by 50% 
25 to 70%. Further, the converted result shows no enhanced color noise and provides improved image quality. Note that 
the luminance Y is not necessarily obtained with strict weighting as in equation (1 ). For example, the following equation 
(12) using a simple mean value does not produce a very large error. 

30 Y=(R + G+B)/3 (12) 

[01 01] For more simplification, it may be arrangedsuch that in equation (1 ), only the G component having the greatest 
contributing value to the luminance Y is regarded as the luminance Y This does not always cause a large error. 
[0102] As described above, steps S110 to S150, to sum up edge amounts so as to judge the sharpness level of the 

35 image, correspond to the summation process unit; steps S210 to S250, to set a threshold value to determine edge 
enhancement level and to determine a pixel to be edge-enhanced, correspond to the edge-enhancement element 
determination unit; and steps S310 to S340, to perform edge enhancement calculation on pixels to be subjected to 
edge enhancement processing, correspond to the edge enhancement unit. Further, the processing by a hardware 
device and a software program to obtain image data handled in the edge enhancement processing correspond to the 

40 image-data obtaining unit. 

[0103] On the other hand, in the above description, whether or not edge amounts are summed up is determined 
based on whether or not each pixel is an outline pixel, however, this determination is used in only one example where 
summation is performed with respect to pixels having large edge amounts. The sharpness level of the entire image 
may be judged by so-called weighting with attention to pixels having large edge amounts. In the above-described 

45 example, only if it is determined at step S120 that the pixel is an outline pixel, the edge amount is integrated, and the 
number of pixels is incremented at step S130, however, as shown in Fig. 21 , the summation may be performed with 
respect to all the pixels such that as the edge amount increases, the weight increases. The edge amount is divided by 
the number of pixels as a result of integration with weighting, thus obtaining a result where pixels having small edge 
amounts are processed with a low attention level while pixels having large edge amounts are processed with a high 

so attention level. 

[01 04] The method for actual weighting in this case may be appropriately changed. Further, it may be arranged such 
that the number of outline pixels are summed up based on whether or not each pixel is outline pixel while adding 
attention to pixels having large edge amounts. 

[0105] Next, the operation of the present embodiment having the above construction will be described in order. 
55 [0106] The description will be made on the assumption that the scanner 11 reads a photographic image, and the 
printer 31 print-outputs the read image. First, the image-processing application program 21 d is activated when the 
operating system 21 a is operating in the computer main body 21 , to cause the scanner 1 1 to read the photograph. The 
read image data is read by the application program 21 d via the operating system 21a, then a pixel of interest is set, 
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and at step S1 1 0, the edge amount is determined based on equations (2) to (4). At step S1 20, it is determined whether 
or not the pixel of interest resides in an outline portion, based on the edge amount. Only if the pixel is an outline pixel, 
its edge amount is integrated and the number of pixels in the outline portions is incremented. 
[0107] At step S140, the above processing is repeated while the position of the pixel of interest is moved, until it is 

5 determined at step S150 that the processing on all the pixels has been performed. When all the pixels have been 
processed, the ratio of the number of outline pixels is calculated at step S21 0, and the threshold value used for judgment 
of edge-enhanced pixel is calculated at step S220. At step S230, the mean value of edge amounts of the outline pixels 
is calculated from the integrated edge amount and the number of pixels, and at step S240, the edge enhancement 
level Eenhance is calculated from equations (6) and (7), based on the image size according to the image data. 

10 [0108] Next, at steps S310 to S340, actual edge enhancement processing is performed on each pixel while the 
position of the pixel of interest is moved similarly to the above processing. In this case, as described above, one of the 
unsharp masks 41 to 43 may be selected in accordance with the edge enhancement level Eenhance. Further, the 
processing speed can be improved by omitting calculation based on various calculation reducing methods. 
[0109] Thereafter, the edge-enhanced image data is displayed on the display 32 via the display driver 21c. If the 

15 displayed image is excellent, the image is printed by the printer 31 via the printer driver 21b. That is, the printer driver 
21b inputs the edge-enhanced RGB multi-level data, performs rasterization corresponding to a print head area of the 
printer 31 via a predetermined resolution conversion, converts the rasterized RGB data to CMYK data, then, converts 
the CMYK multi-level data to binary data, and outputs the data to the printer 31 . 

[01 1 0] By the above processing, the image data of the photograph read via the scanner 1 1 is automatically subjected 
20 to optimum edge enhancement processing, then displayed on the display 32, and print-outputted by the printer 31 . 
[0111] In this manner, the computer main body 21 , which functions as the nucleus of edge enhancement processing, 
generates a vector from the difference value of data between adjacent pixels and obtains an edge amount as a change 
level at step S110, selects only pixels having large edge amounts and integrates the edge amounts at steps S120 and 
S1 30, and obtains the mean value at step S230. The computer main body 21 obtains the sharpness level of the image 
25 while adding attention to the pixels having large image change levels, then determines the edge enhancement level 
Eenhance based on the obtained sharpness level of the image. Thus, the computer main body 21 automatically per- 
forms edge enhancement processing at an optimum enhancement level. 

30 Claims , 

1. An edge enhancement processing apparatus comprising: 

an image-data obtaining unit which obtains multi-level image data representing an image with pixels in dot 
35 matrix; 

an edge enhancement level obtaining unit which obtains an edge enhancement level; 
an edge enhancement level correction unit which detects an image size of the image data, and corrects the 
edge enhancement level such that as the image size increases, the edge enhancement level increases; and 
an edge enhancement unit for corrected enhancement level which performs edge enhancement processing 
40 on respective edge pixels based on the corrected edge enhancement level. 

2. An edge enhancement processing method for performing edge enhancement processing on multi-level image data 
representing an image with pixels in dot matrix, comprising: 

45 a step of obtaining multi-level image data representing an image with pixels in dot matrix; 

a step of obtaining an edge enhancement level; 

a step of detecting an image size of the image data, and correcting the edge enhancement level such that as 
the image size increases, the edge enhancement level increases; and 

a step of performing edge enhancement processing on respective edge pixels based on the corrected edge 
so enhancement level. 
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FIG. 6 
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FIG. 7 
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FIG. 10 
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